SAMPLINGS AND OBSERVABLES. INVARIANTS OF METRIC 

MEASURE SPACES. 



GABOR ELEK 

Abstract. In the paper we are dealing with metric measure spaces of diameter at most 
one and of total measure one. Gromov introduced the sampling compactification of the 
set of these spaces. He asked whether the metric measure space invariants extend to the 
compactification. Using ideas of the newly developed theory of graph limits we identify 
the elements of the compactification with certain geometric objects and show how to 
extend various invariants to this space. We will introduce the notion of ultralimit of 
metric measure spaces, that will be the main technical tool of our paper. 
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1. Introduction and preliminaries 

1.1. Metric measure spaces. Let x denote the set (up to isomorphisms) of Pohsh spaces 
X of diameter at most one equipped with a Borel probabihty measure nx of full support. 
In the course of the paper, we refer to these objects as mm-spaces. We say that (X, /ix) 
and (F, /iy) are equivalent if there exists an isometry $ : X — )■ F such that ^^{^x) = ^^Y■ 
The space x has a Polish space structure. Note that we will often use the notation X 
instead of (X, /ix). The distance of X, F G x is defined the following way [5]. Consider the 
set MPM{X) of measure preserving maps \l/([0, 1], A) — )■ (X, fix), where A is the Lebesgue 
measure. Let "^'^{dx) be the pull-back of the distance function of X^. Then 

□i(x,r)= ^^^^^^inf n,i^^\dx),^^\dy)), 

where the Di-distance of the measurable functions f,g : [0,1]^ — )■ [0,1] is defined as the 
supremal e such that / and g are e-close outside a subset X^ C [0, 1] of measure at most e 
that is, 

\f{x,y) -g{x,y)\ < e 
for G ([0,1]\X,) X ([0,1]\X,). 

1.2. Samplings. Gromov introduced an other notion of convergence in Xi convergence 
in samplings [5j (see also [ID]). Let Moo be the convex compact metric space of infinite 
matrices {iii,j}f^>i with < dij < 1, dij = dj^i,di^i = 0. We have a continuous map 
p : X^ — )■ Moo that assigns {dtj = dx{xi,Xj)} to the sequence (xi,X2,...) G X^. We 
denote by /i^ the push-forward of the measure px x Px ■ ■ ■ ■ According to the Reconstruc- 
tion Theorem (355. [Sj), the map r : x — )■ V{M^) is a continuous injective map (where 
P(Moo) is the space of probability measures on Moo). Thus the closure of r(x) gives us a 
compactification x of x- We say that {Xn}^=i is convergent in sampling if {r(Xj)}^]^ is a 
weakly convergent sequence. We use the notation X„ A- X, if {r(Xj)}°° — )• r(X) weakly. 
One of the main motivation for writing this paper was a remark of Gromov in Section 3| 
of his book [5]. He asked whether the invariants of mm-spaces can be extended to x- 
our paper we argue that the answer is yes, the elements of x can be regarded as geometric 
objects. 

Let G be a finite simple graph. We can associate an element Xq G x the following way. 

= dx{a,b) = 1/2 if a and b are connected and dx{ct,b) = 1 otherwise. It is 

important to note that {Gn}'^=i is convergent as a dense graph sequence (see e.g. [2]) if 
and only if {Xg„}^i is convergent in sampling. Our paper uses the ideas and methods of 
graph limit theory in a substantial way. 

1.3. Quantum metric spaces. Let (X, /i) be standard Borel space with a probability 
measure and d* : X x X — )■ P[0, 1] be a probability measure space valued Borel- measurable 
function, such that d*{x,x) = 6o and d*{x,y) = d*{y,x). Then for a triple of different 
points a, b, c points we can pick independent random lengths l{a, b), l{b, c), l{a, c) using the 
probability measures d*{a,b),d*{b,c),d*{a,c). If for /i-almost triples the random lengths 
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satisfy the triangle inequality, we call {X,fi,d*) a quantum metric measure space, a qmm- 
space. Then, for any qmm-space X we can associate an Soo-invariant measure t{X) the 
following way. First consider the convex compact metric space of infinite matrices 
with coefficients d*ij in V[0, 1] such that d*j = d*i, (i* j = 60 . An element u G Mqo defines 
a probability measure on Moo- By the definition of qmm-spaces, we have a continuous 
map — > Moo and we consider the push-forward of fix x /^x x . . . . This is a probability 
measure on a convex compact space (i.e the space of probability measures on M^o) so one 
can consider its barycenter. This will be the associated probability measure t{{X, fi,d)). 
We will prove that qmm's completely represent x- 

Theorem 1. If k &x then there exists a qmm-space X such that t{X) = n. 

We can extend the metric to qmm-spaces as well. If / and g are V[0, 1] -valued 
weak-*-measurable functions on [0, 1]^ then their Di-distances can be defined again as the 
supremal supremal e such that / and g are e-close in the de^r distance, outside a subset 
X^ C [0, 1] of measure at most e. Here dext is the metric extension of the usual distance on 
[0,1] onto V[0,1]. That is 

dext{l^,'^)= sup \ fdfi- fdu\ 

/6Lipi[0,l] Jo Jo 

Thus 

□i(X,F) = inf □i((^i)-i(rfx),(^2)-'(rfy)). 

*iGMPM(X),*2eMPM(y) 

Note that two qmm-spaces with zero D^-distance are not necessarily isomorphic. However, 
we will prove the following reconstruction theorem. 

Theorem 2. If X,Y are qmm-spaces then t{X) = t{Y) if and only if n^{X,Y) = 0. In 
fact, if t{X) = t(Y), then there exist ^1 G MPM{X) and ^2 e MPM{Y) such that 
{^>^)-\dx) = {^2r\dY). 

It is important to note that the idea of qmm-spaces is already implicit in the work of 
Lovasz and Szegedy [7|. Also, Theorem |2] is an analogue of the uniqueness theorem of [T], 
proved originally for graphons (which can be regarded as special kind of qmm-spaces). 

1.4. Observables and mm-invariants. Let us recall some of the most important mm- 
invariants from Let F be a compact metric space with diamiY) < 1 and X G x- 
Denote by Lipi{X,Y) the set of 1-Lipschitz functions from X to Y. We can associate to 
X a compact subset A^y(X) of V{Y) by 

One can think about A^y (X) as the information Y can see by screening X. We will extend 
the notion of Lipschitz maps to qmm-spaces and prove that M.y{0 is well-defined on x- 

Let V G ViX) and < k < 1. Then diam{v, k) is the infimal D such that D contains 
a subset Yq such that diamiYo) < D and //(Yo) > 1 — k. The observational diameter is 
defined as 

ObsDiamyiX, K.) = sup diam{f^{iix)i 1^) ■ 

feLipi{X,Y) 
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Example 1 Let {i^'m}^^ be the sequence of complete graphs on n vertices. 
Then tends to a point measure a on M^o- Also, ObsDiamyiXK^, — )■ 

diam{Y, k) for any Y, diamiY) < 1/2 and < k < 1. This follows from the fact that any 
map Kn to Y is 1-Lipschitz. Now, consider the sequence {S^}'^^^ of Riemannian spheres 
of dimension n with diameter 1 equipped with the normalized volume measure. Then 
{r(S'")}5^]^ tends to a as well. However, ObsDiamyiS"', k) — )■ for any Y and k (by the 
Levy Concentration Phenomenon). Thus the samplings, in general, do not capture the 
observational diameter. However, we have the following proposition. 

Theorem 3. The function ObsDiamY{-, can be extended to x (^it- essentially upper 
semi- continuous way. That is, for any Y and < k' < k, if Cm C weakly then 



Let Ki, K2, . . . , hn be positive numbers such that Yli=i < The separation distance 
Sep{X, Hi, ^2, . . . , fi^Ar) is the supremal 6 such that there exist Borel sets Xj C X, fJ.{Xi) > Hi 
such that distx{Xi, Xj) > 6. Obviously, 



Theorem 4. For any ki, K2, . . . , kat, the function Sep{., ki, K2, . . . , K^r) extends to x o,s an 
upper semi- continuous function. 



Let (X, fi, A) be a probability measure space with a cr-algebra A. Let / : X — )• R be 
a bounded measurable function and C v4 be a sub-a-algebra. According to the Radon- 
Nikodym Theorem there exists a unique measurable function E{f \ B) G L°°{M, fi, B) such 
that for any B E B 



For the next paragraph our reference is [Chapter 3.]|9]. In our paper we use sometimes 
Banach valued measurable functions. In this category, there are several notion of measur- 
ability and integral. What we need is the Gelfand-Dunford integral of weak-*-measurable 
functions. So, let L be a Banach space, and L* be its dual. An essentially bounded 
function / : (X, /i. A) — )■ L* is called weak-*-measurable, if for any v E L, the function 
X — > {f{x),v) is ^-measurable. Note that this is equivalent to say that as a map / is mea- 
surable with respect to the weak-*-topology of L*. We denote the space of these functions 
by l^t{X, fi, A, L*). The Gelfand-Dunford integral / fdfi of such a function is the unique 
element of L* such that 



holds for any v E L. Then we still have a Radon-Nikodym type theorem, based on the 
theorem of Dunford and Pettis. The following result was explained to us by Nicolas Monod. 



limsup ObsDiamyiCni f^) < ObsDiamyiC, k!) ■ 



lim Sep{XK^, ki, H2, ■ ■ ■ , i^n) = 1/2, Sep{XK„, ^i, K2, . . . , kn) = . 



2. On the Radon-Nikodym-Dunford-Pettis Theorem 
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Proposition 2.1 (Radon-Nikodym-Dunford-Pettis Theorem). Let {X,fi,A) and f be as 
above. Then there exists an essentially unique function E{f \ B) which is weak-* -measurable 
with respect to the a-algebra B, such that for all v & L and B & B 

[ {Eif\B)ix),v)dfi= [ {fix),v)dfi. 

J B J B 

Proof. By the original Radon-Nikodym Theorem for all f G L there exists a bounded 
i3-measurable function fy such that for any B & B 

[ {Eif\B)ix),v)= [ fydfi. 

J B J B 

Observe that the map f — )■ is a continuous linear operator, that is an element of the 
space Hom{L,l'^{X,n,B)). Note that Hom{L,l°°{X, fi, B)) ~ Hom{l\X, fi, B, L*). On 
the other hand, by Proposition 2.3.1 

i::,{X,fi,B,L*) Hom{L,r{X,fi,B)) 

Hence the function v ^ f^ is represented by a weak ^-measurable function. □ 

Now let / : {X,A,fi) — )■ [—k,k] be a measurable function. Notice that / can be viewed 
as a function / : {X,A,^) — > C[—k, k]*, where C[—k, k]* is the dual space of the Banach 
space C[—k,k]. Here f{x) = the point measure concentrated in f{x). Then one 

can consider both E{f \ B) and E{f \ B). In case of f = id : ([0,1], A) — i- [0,1], 
E{f I {0, 1}) = 1/2 and E{f \ {0, 1}) is the Lebesgue measure. Now let F be a compact 
metric space and / : {X, A, fi) ^ Y he a measurable map. Then E{f \ B) is a well-defined 
i3-measurable C(F)*-valued function on X. On the other hand, in general E{f \ B) does 
not have a meaning. If G : F — )■ R is a continuous function then {E{f \ B),G) is a 
measurable function on X and it is the Radon-Nikodym derivative of G o /. This also 
shows that E{f | i3) is a probability measure valued function. 

Finally, let us recall the notion of an ultralimit. Let y be a compact metric space and u be 
a nonprincipal ultrafilter. Let {?/„}^^ C F be a sequence of points. Then the ultralimit 
lim^ Hn is the unique element y such that for any e > 

{n I dyiyn.y) < e} G w 

Note however that we can define an ultralimit /im^ that is valued in 'P(V), the space of 
probability metric spaces on Y . Consider the natural embedding i : Y ^ ^(^)- Then 
we have a sequence {i{yn)}^=i C ViY) and the ultralimit lira^^yn = limaji(yn) £ 'PiX) ■ 
Clearly, if G G C{Y) then 

{lim^yn,G) = G(lim?/„) . 
We will use the following lemma later. 

Lemma 2.1. Let B d A two a-algebras on a set X and let f : (X, A, fi) — )■ [0, 1] be an A- 
measurable function. We denote by J, E{f \ B){x) resp. by f E{f \ B){x) the infimum resp. 
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supremum of the support of the measure E{f \ B){x). Then if f > e fx-almost everywhere 
on a set B E B, then J, E{f \ B){x) > e fi-almost everywhere as well. Similarly, if 
t E{f I B){x) < e fi-almost everywhere, then f E{f \ B){x) > e fi-almost everywhere as 
well. 

Proof Let < 5 < e and ^ G C[0, 1] such that g{t) = 1 if t < g{t) = if t > e. Let 
C G S the subset of B on which i E{f \B)<5. Then if /i(C) > 0, 

0< / {E(f\B),g)diJ= I fogdfi = 0, 
Jc Jc 

leading to a contradiction. 

3. Ultralimits of measured metric spaces 

Let {Xn}'^^i be a sequence of Pohsh spaces and let w be a nonprincipal ultrafilter. 
The ultralimit of Polish spaces was defined in 3.22 [5] the following way. We say that 
{xi}°l-j^, {x'^°l^ C rii^i -^i equivalent if lim^^ dxii^i^^'i) = 5 where lim^ is the associ- 
ated ultralimit. The elements of the ultralimit space X are the equivalence classes [{xj}]^^. 
The set X is a metric space 

dx([x], [x']) = lim dxXxi,x'i) ■ 

UJ 

Then X is a complete metric space, but usually it is not separable. In order to define 
a measure on X we need some preparation. Consider again the spaces {Xj}^^ C x 
their set-theoretical ultraproduct. From now on, we will use the phrase set-theoretical 
ultralimit, since from our point of view, it is very much like the classical ultralimit. Now, 
two sequences {xi}°li and {x'^^l^ are equivalent if 

{i \ Xi = x[} G CO . 

The set-theoretical ultralimit is denoted by X. Then we can define a pseudo-metric on X, 
by 

dx([x], [x']) = \imdx,ixi,x'i) . 

UJ 

Here, [x] denotes the new equivalence class. Then we have a natural map tt : X — > X- In 
nonstandard analysis, the inverse images of an element [x] in X are called monads M([x]). 
The elements of M([x]) are infinitesimally close to each other. Now we define the ultralimit 
of subsets the following way: [{cti}] G A if and only if 

I Oj G Ai] G u . 

The ultralimit sets A form a Boolean algebra V. We have a finitely additive measure /xx 
on V and this finitely additive measure can be extended to a a-algebra containing 
V ( see |1] and [B]) the following way. Let N C X be a nullset if for any e > there exists 
an element A G P such that N C A and /ix(^) < A set M C X is measurable if there 
exists P G P such that PAM is a nullset. The set of measurable sets is a cr-algebra 
with a probability measure, where we define ;Ux(M) = yUx(P)- We call a set A G X 
admissible if vr~^(A) G Ad. The admissible sets form a a-algebra Al. The measure /ix is 
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defined on A G Ai by /ix(A) = /^x(7r ^(A))- We do not claim tliat Ai always contains all 
the Borel-sets, in the light of the following example. 

Example 2. Let Xi = Ki, where \Ki\ = i,d{x,y) = 1 ii x ^ y E Ki. Then X is an 
uncountable discrete set therefore all of its subsets are Borel-sets. 

However, we prove that balls are always in Al, so Al contains the Borel sets, if for some 
reason X is a separable metric space. 

Lemma 3.1. //x e X, e > 0, then 5,(x) G M. Here B^{x) = {y G X | dx(x,y) < e}. 
Proof. We need to prove that tt^^{B^{x.)) G Ai. Let x = [{xj}]. Consider the sets 

limS^ , 1 (xj) = Bk e M. 

If y G 7r-i(5,(x)), then y G n^^Bfc. On the other hand, if y G n^^Efc then dx(x,y) < e. 
Therefore, 7r-i(5,(x)) = n^^Bfe & M. □ 

In the course of this paper, we use bold letters for objects in the set-theoretic ultralimit 
and underlined bold letters for the objects in the metric ultralimit. If A is the ultralimit 
of {A„}5^i, then we use the notation lim^ An = A. 

Example 3. For an mm-space X, the distance function is Borel on X x X. This is not 
always the case for the ultralimit spaces. It is possible that d is not even AixAi measurable 
on X X X. Note that if one considers the set-theoretic ultralimit of the spaces Xj x Xj, 
then it is the same space as X x X, however its algebra of measurable functions A^2 can 
be much bigger than Ai x Ai. This phenomenon can be observed if Xj = Xd , where Gi is 
a random graph (each edge is chosen with probability 1/2). Then with probability 1, the 
distance function on the ultralimit will not be x -measurable (see |^4j). However, as 
we shall see soon, the distance function on X x X is always Al 2 -measurable. 

Let (X, yu) be an mm-space. Recall that the support of /i is defined the following way. The 
point p G X is not in the support of /i if /i(i?e(p)) = for some e > 0. Clearly, the support 
is a closed set with fi{Supp{^)) = 1. Note however that for some ultralimit spaces such as 
in Example [2], the support of the measure can be empty. 

4. Analysis on the ultralimit 

In this section we fix a sequence {Xj}^^ C x- As in the previous section X denotes their 
set-theoretic ultralimit and {Ai, fix) stands for the algebra of measurable sets in X with 
the ultralimit measure. The results in this section are known in the finite graph setting 
(see Section 5 of Let {/, : Xj — )■ [a, 6]}^]^ be measurable functions. Their ultralimits 
are defined by 

f([x]) = lim/j(a;j) . 
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Proposition 4.1. The ultralimit function f is M. -measurable and 



Conversely, z/g : X — >■ [a,b] is a A4 -measurable function, then there exists a sequence of 
functions {fi : Xi — >■ [a, &]}^i such that their ultralimit ^-x^-almost everwhere equals to g. 

Proof. In order to prove that / is measurable, it is enough to see that 

f[e,d] = {p G X I c < f (p) <d}eM, 

for any [c, rf] C [a, 6] . Let P„ = [{fli ±i}£i] • Clearly, f[c,d] = n,^=iP„, thus f[c,d] G M. 

Now fix /c > 1 and let /ij : Xj — )■ R be a measurable stepfunction such that hi{x) = 
when ^ < fi{x) < Clearly, |h — f | < ^ on X. That is 

^ hd//x - J fdii:sL < ^ ■ 

Also, I hidjjLXi ~ fx fidfJ'X.l < Observe that the ultralimit function h can be written 
as J2 jkXCj, where Cj is the ultralimit set of {Cj}^i, Cj = {x G | hi{x) = ^} . 
Therefore J^hd^x. = hnia, fx. hid^Xi ■ Consequently, for any /c > 1, 



Thus 



hm / fid[XXi 



< 



2k- 



f d.^ = hm /idyUXi ■ 



Now let us prove the converse statement. Let g^ : X — > [a — 1, 6 + 1] be the step function 
approximation of g, that is, gfc = E 2^X0,,^, where C^-fc = {x G X | ^ < g(x) < 
By modifying g on a set of /ix-measure zero, we can suppose that Cj^k G V. Note that 
|g(x) - gfc(x)| < ^ on X, and |gfc(x) - gj(x)| < jj ii k> j. Let T]^^ C be Borel sets 
such that Cj^k — Tj^^. Let fl = Yli ^Xr?^ ■ We define El C X, in the following way 



El^{xeX,\ \fl{x) - f]{x)\ < ^ for all 3<k}. 

Then 

Let h{i) = min{i,sup{A; | i G Sk}}- Thus for any k>l 
(1) {i I > A;} G a;. 

Let gl — f^^. We claim that g' = hm^^ Qi. — S /^x-almost everywhere. Let 

Vi = {^eX\\g'{x)-gi{x)\>^}. 
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What we need to prove is that for all I > 1, /ix(Vi) = . Since gi = lim^ it is enough to 
show that for any A; > 

(2) I I g'iix) - fi{x)\ < ^) > 1 - ^} e u 

However, (|2]) follows from ([1]). □ 

5. Sampling qmm-spaces 

5.1. q-samplings. In this subsection, we show how one can extend r onto qmm's. This is 
described in [7] in a slightly different situation using somewhat different terminology. Let 
M„ be the convex compact space of n x n real matrices satisfying < dij < 1, dij = dj^i 
and di^i = . Also, let Mn be the convex compact space of P[0, l]-valued matrices satisfying 
d*j = d* i, d*i = 6o . An element of M„ can be viewed as a probability measure on M„. For 
a probability measure z/ on M„ one can consider its barycenter b^u). Let (X, /i, rf*) be a 
qmm-space. Then the push-forward of /i x /i x ■ ■ ■ x /i for the natural map p„ : X" — )■ M„ 
is a probability measure z/„ on M„. Its barycenter 6(z/„) = r„((X, yU, d*)) is the n-sampling 
measure of (X, /x, d*). Note that Moo is the inverse hmit of the spaces M„ and b{i'n) is the 
push-forward of b{i') = r((X, /x, d*)) constructed in the Introduction. One can also look at 
the measures bi^Un) by taking moments. Let g = {gij : [0, 1] — > R}i<i<j<„ be a system of 
continuous functions. They define a continuous function qg = Y[i<i<j<n9ij '^^ 

Lemma 5.1. 

Proof. We have a continuous map ig : M„ — )■ R defined by ig{s) = Yii<i<j<n(^v^ 9v) ^ 
where s = {sij}i<i<j<n € Mn . By the definition of the push-forward, 

/ n {d{xi,Xj),gij)d^{xi)d^{x2) ■ ■ ■dii{xn) = i ig{s)dvn{s) . 

l<i<j<n J^r. 

On the other hand, by the definition of the barycenter 



[s)dun{s) = / Yl {sij,9ij)diyn{s) = / ( JJ gij)db{vn) □ 



l<i<i<n l<i<J<n 



Following [7], we denote Y[i<i<j<r{di^i^^j)j 9hj)df^^ KQi^)- Observe that the lin- 
ear combinations of the functions qg are dense in C{Mj). Therefore, r((Xi, /ii, rfj)) = 
r((X2, /i2, c?2)) if only if t{g,Xi) = t{g,X2) for all r > 1 and system g. 

Let {Xn}'^=i C X be mm-spaces. Let {X^}^^^ C x be their /c-fold product spaces with the 
metric dk{x,y) = maxi<j<fc We consider the ultralimits X, . . . . As we noted 

before, the cr-algebras of measurable sets A^^ in X^ are in general much bigger than the 
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product cr-algebras Ai x J\A x ■ ■ ■ x J\A. We will denote by A^|. C Aik the subalgebra 
of sets depending on the i-th coordinate. That is JH^ ~ Ai. Also, we will denote by 
M.^jl-' the subalgebra of sets in Aik depending on the i-th and the j-th coordinate. That is 
A^^'"* ~ A^2- The ultralimit distance function d is measurable function in (X^, /i^, A^2); 
hence we can consider the Radon- Nikodym-Dunford- Pettis derivative d* = E{d \ Ai x 
M) : Xx X^P[0,1]. 

A separable realization of d* is a measurable map \E' : (X,/ix,d*) — ([0, l],fj,x,d*), where 
the Borel measure fix is the push-forward of /ix, d* is the pull-back of the Borel function 
d*. Now we show that ([0, 1], fix, d*x) is always a qmm-space. In fact, we have the following 
proposition. 

Proposition 5.1. Let {Xn}'^^-^ C x be mm-spaces and ([0, l],fix,d*x) be a separable real- 
ization of their ultralimits then lim^ t(X„) = t(([0, 1], /Ux, d\)). 

Proof. First, let us fix an r > 1 and a system of continuous functions as in Subsection 15. 1[ 
By Proposition 14. 



(3) 



lim / TT gij{dx„ixi,Xj))dfi'x„= TT gij{d{xi,Xj))dfi^y^ , 



where d is the ultralimit of the functions dx^- 
Lemma 5.2. 

/ n 9ijidi^i,^j))dlix= n (^*i^i^^j)^9ij)dlix 
Proof. By definition, 

(4) E{gij{d{xi, Xj)) I M, X Mj) = (d*(xi, ^j),gij) 

By the Integration Rule [Proposition 5.3] [1], if hj^ : X'' — )■ R are bounded A^jj-measurable 
functions then 

/ n h^^-^/'x = / n ^(hi. 1-^ xMx... M)dff^. 

Hence by (jlj) the lemma follows. □ 
Since d* is measurable on £ x £, we immediately obtain from the lemma that for any 
separable realization ([0, 1], fix, d*)\ 

/ n ' ^-J' ) ) = / n ^S'i ' ^* ' ) ^ • 

l<i<j<r •^i^'^y l<i<j<r 

Note that lim;^ t(X„) is well-defined since V{Moo) is a compact metric space. By the 
definition of the ultralimit, lim^j t(X„) = k if for any continuous function g G C(Moo) 

lim(r(X„),5() = {n.g) . 

to 

Hence our proposition follows. □ 
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Note that we never actually checked that the triangle inequality condition holds for the 
limit qmm-space {[0,1], fix, d*). However, let gl'^'^ : M^o — )■ R be a continuous function, 
that equals to 1 if dij + djk — dik < e. Since = \\m^{T{Xn),g\'^'^) = {t{[0, I], fix, d*),g]^^'^) 
one can immediately see that the measure of "bad" triangles is zero. That is ([0, c?*) 
is a qmm. Thus we proved that for any k G x, there exists a qmm-space X such that 
r(X) = K. 

5.2. Martingales. Let {X,fi,d*) be a qmm-space. The way we obtained r„(X) can be 
described by the following sampling process. First pick n points in X //-randomly, inde- 
pendently and then for any i < j choose d{i,j) randomly according to the probability 
measure d*{xi,Xj). If /i is atomless, then by probability one we obtain a finite mm-space. 
For measures with atoms, we get pseudometric spaces. Now let us fix r > 1 and a system 
g = {gij : [0, 1] — )► R}i<i<j<r. as in the previous section. Then we have the following mar- 
tingale {Bm, Mm, Bm}m=o- ^hc (j-algebras are the standard Borel algebras Bm on Mm, for 
1 < m < n. Bo is the trivial algebra. The measures are Tm{X), 1 < m < n. The function 
Bn : Mn — )■ R is defined by 

where the summation is taken for all maps : [r] — )■ [n] and 

tc^{g,Y)= JJ gij{dY{i,j)) . 

Recall that t{g, Y) = Y[i<i<j<r 9iji^YiPi^Pj))^^^^iP)■ Since F as a measure space is just [n] 
with the uniform measure, t{g, Y) = Bn{Y) . Then let 

Bm = ^y2^^^^^9) \Mm)iY), 



Note that this is a standard use of martingales in graph limit theory see e.g [7]. Let 
Bq = Jj^j BndTn = t{g,X). Observe that if does not take the value m, then 

Emig) I Mm) = Em{g) \ M„_i) 

. Then we have the inequality 

\Bm - Bm-i\ <^rY^ \E{U{g) \ Mm) - E{t^{g) \ M„_i)| . 

Otherwise, \E{t^{g) \ Mm) - E{t^{g) \ M„_i)| < ni<i<j<r lls'^ll = Cg . Hence, |5„ - 
Bm-i\ < \cg . Therefore, using the Azuma Inequality we obtain the following proposition. 

Proposition 5.2. 

— e^n 

Prob{Y G M„ I t{g,Y)-t{g,X) > e) < 2exp(^— ) . 

ZCg 

By the Borel- Cantelli Lemma we immediately obtain the following corollary. 
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Proposition 5.3. For any fixed r > 1 and system g, for T{X)-almost all ( G M^o 

t{9,X) = lim t{gXn) , 

n^oo 

where (n is the pseudometric space on the first n coordinate on (. 

So, if X is atomless, then Cm ^ X cind t{X) = lim„_j.oo t(C„). If X has atoms, then 
t{X) = lim„_>oo T(Cn)) where Cn is the mm-space associated to (n- Therefore, t(X) G x for 
any qmm-space. This finishes the proof of Theorem [H 



6. The Reconstruction Theorem 
6.1. The compactification and qmm-spaces. In this section, we prove Theorem |2J 

Proposition 6.1. Let xq be the metric space of equivalence classes (under the pseudo- 
metric n^) of qmm-spaces. Then t : xq X is a continuous bijection. In particular, if 
□i(X,r) = then t{x) = T{y). 

Proof. Let \1/ : ([0,1], A) — i- X be a measure preserving map. Then clearly, t{g,X) = 
t{g,'^~^{X)), where \I'~^(X) is the induced qmm-structure. Since Lipschitz-functions are 
dense in C{Z) for any compact metric space Z, the proposition follows from the lemma 
below. 

Lemma 6.1. For any r >1, system of K-Lipschitz functions g = {gij}i<i<j<r md e > 
there exists 5 = 6r,g,e > such that if Di{fi, f2) < S for two weak ^-measurable P[0, 1]- 
valued function on [0, 1]^, then \t{g, ([0, 1], A, /i)) — t{g, ([0, 1], A, /2))| < e . 

Proof. 

|t(^7,([0,l],A,/i))-t((?,([0,l],A,/2))| = 



''[OAV l<i<j<r ^<i<i<r 



l<i<j<r 



< 



< 



),gij))dX 

x&[0,lY ,{^i,Xj)&N(h,f2,t) l<i<j<r l<i<j<r 



+ 



( n (/i(^i'^i)^ii) - n {f2{xi,Xj)gij))dX' 

xe[0,l]'",{xi,Xj)^N{fij2,€) i<i<j<r l<i<j<r 

where N{fi, /2, e) = {{x,y) e X x X \ dext{fi{x, y), f2{x, y) < e} . For the second term, we 
have the upper bound 2cgy{x G [0, l]^ (x„ x,) G iV(/i,/2,e)) < 2c,f A2(iV(/i, /2, e)) . 
To estimate the first term of the right hand side of inequality above, observe that by the 
definition of the extended metric d^xt 



\{fl{Xi,Xj) - f2{Xi,Xj),gij) < Kdext{fl{Xi,Xj) - f2{Xi,Xj)) 
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Note that for positive numbers Cj, di,l < i < n and T: 

n n 

in(^^+^)-n^^)i ^ (2r)"^sup iq 
1=1 

This gives us the upper bound 



i=l 



l<i<n 



xe[0,l]^,{xi,Xj)eN{fij2,t) i<i<j<r l<i<j<r 



< 



< i2Kesnp\g,,\)y 
This immediately shows that if d{fi, is small enough then 

\t{g, {[0,1], X,f,))-t{g, {[0,1], X,m<e. 



□ 



6.2. Random maps. Let {X,fi,d*) be a qmm-space. We can suppose that X = [0,1]. 
Let us pick a sequence {xn}'^=i of independent /i-random points. For each pair {i,j)i<j we 
pick a real number d{i,j) independently according to the probability measure d*{xi,Xj). 
That is we pick a t{X, h, c?*)-random element x of M^q. Let X„ be the restriction of x on 
[n]. Then we have a natural map 7r„ : X„ — )■ [0, 1] defined by 7r„(i) = Xj. We denote by n 
the ultralimits of the maps 7r„ . 

Theorem 5. The map tt : X — t- [0, 1] is a separable realization with probability 1. That is 
^,t(/^x) = O'lT'd (tt X 7i)^^{d*) = almost everywhere. 

Proof. We have two kind of randomness in our construction. First, the random choice of 
{xn}, then the choice of d{i,j) according to the law d*{xi,Xj). The following lemma is 
about the second kind of randomness. 

Lemma 6.2. For any choice of {xi}'^i and k > 0, with probability one 

'^ieA„,jGB„d{hj)^ _ 'l2ieA„,j£B„(d*{Xi,Xj),t^) 



lim 

n— >oo 



for all sequences {An, Bn C [ri]}^^!, where \An\, |i?„,| > m for some e > 0. Here t^ denotes 
the k-th power of the identity function on [0, 1]. 

Proof. First, let us recall the Chernoff inequality. If Xi, X2, . . . Xm are independent random 
variables, taking values in [0, 1] and 5 > then 



(5) 



Proh 



ET=iX^ YZiE{x, 



m 



m 



> 6] <2 exp 



Let us apply ([5]) for a fixed pair An,Bn C [n], |A„|, > en, and the random variables 
{d{i,j)'"}teAr,,j€B„- We get that 
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Therefore the probabihty that 



is larger than 6 for at least one such pair is less than 4*^ exp , ^ 
follows from the Borel-Cantelli lemma. 



. Hence our lemma 
□ 



Taking ultralimits we immediately obtain the following proposition. 
Proposition 6.2. For any A, B G Aii 




iaJb JaJb 

where d*^^ = (vr x 7i)^^{d*) . Consequently, (tt x 7r)^^((i*) = almost everywhere. 
Lemma 6.3. With probability one, vr^(/ix) = • 

Proof. Fix a Borel-set A C [0, 1]. By the Law of Large Numbers, with probability one, 

|{z : x^ G A}\ 



lim 

n—^oo 



\n\ 



That is, with probability one 7rj,(/ix) and /i coincide on all dyadic intervals. Therefore, by 
Caratheodory"s Theorem the two measures are equal. □ 

Now Theorem |5] follows from Proposition 16.21 and Lemma 16.31 □ 

6.3. The Maharam Lemma. Let ([0, 1], .4., /i) C ([0, 1], fi) be two separable a-algebras. 
We say that A is complemented in B if there exists a a-algebra C E B such that the gener- 
ated algebra {A, C) is dense in B and the elements of C are independent from A. Note that 
it means that there exists a a-algebra ([0, l],C',yu') and the measure preserving bijection 

$ : ([0, 1] X [0, 1], ^ X C, X ([0, 1], B, fi) 

such that ^^^{A) = ^ X [0, 1]. Maharam ([8], see also [3]) gave a necessary and sufficient 
condition for having a complement. Namely, for any A; > there exists a partition U 
5*2 U ■ ■ ■ U Sfc = [0, 1], such that Si E B and Si is independent of A. 

Lemma 6.4. Let tt : (X, /xx) — ^ {X, fi) as above a separable realization. Then there exists 
a Maharam partition for any k > 1 in Ai'^. 

Proof. Let {xi,X2, . . . ) be a random sequence as above. For each i > 1, pick an element 
s{xi) C {1,2, . . . , k} randomly with uniform distribution. Then by the Law of Large 
Numbers, for each dyadic set A and 1 < j < k 



lim 

n— >oo 



\{1 <i <n I Xi e A, s{xi) = j} 1 



n k 

with probability 1. Hence the ultralimits of S^ = {s~^{j) fl [n]}, {Si, S2, . . . , 8^} form a 
Maharam partition. □ 
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6.4. The proof of Theorem [2]. Let {[0,1], nx^d^), {[0,1], fxy^dy) be two qmm-spaces 
such that t{{[0,1], fix,d*x)) = r(([0, 1], /^y, ciy)). Let us consider a t{{[0,1], fix,d*x))- 
random element of [0,1]. With probabihty one, both nx '■ (X, /ix, dx) — ^ ([0, 1], yUx, c^x) 
and TTy : (X,yUx,dx) {[0, l],/iy,(iy) are separable realizations. By Lemma EH we have 
a separable a- algebra in A^f" that contains Maharam-partitions for any k > with respect 
to both (7rx)~^(i3[o,i]) and (7ry)~^(i3[o,i]), where i3[o,i] is the Borel algebra. Therefore there 
exist measure preserving maps px '■ {[0, l],pz) — ^ ([0, Py '■ {[0, — ^ ([0, l],/iy) 

such that {px x Px)~^{d*x) and (py x py)~^((iy) coincide. Note that for any Borel proba- 
bility measure ([0, 1], pz) there exists a measure preserving map p : ([0, 1], A) — )■ ([0, 1], pz)- 
Hence Theorem [2] follows. □ 

7. Limits vs. Ultralimits 

Proposition 7.1. Let C x converge to X G x the n^-metric. Then the 

support of their metric ultralimit X is isometric to X. Conversely, if for some sequence 
{^n}'^=i C X the support of the ultralimit is isometric to X E x, then X = lim^; That 
is for any e > 

{n I □i(X„,X) <e}eu. 
Proof. We start with two lemmas. 

Lemma 7.1. Let {Y,d) be a complete metric space equipped with a probability measure p, 
such that supp{p) = Y . Then Y is separable. 

Proof. Let us consider the set 5*^/2 of e/2-balls in Y. Take a well-ordering Bi,B2. . . of 
S'e/2 and for each ordinal a, let /(a) = p{VJi3<^aBp). Then there is a countable ordinal a 
such that f{ot) = f{'y) for any 7 > a. Therefore, we have countable many balls of radius 
e/2 such that the measure of their union is greater or equal than the measure of the union 
of any countable subset of However, it means that the e-balls around the centers of 
these balls cover the whole set y. □ 

Now the first part of the proposition easily follows. By ([3]), 

T{supp{px.)) = r{X) . 
Hence by the reconstruction theorem of Gromov, X and supp{px.) are isomorphic. 

Now let us turn to the converse statement. Let {X,p,d) be an mm-space. with k given 
points Xi,X2, ■ ■ ■ ,Xk such that for some e > 5 > 0, p{U^^^BxX^)) > 1 ~ where BxX^) = 
{y e X \ d{xi,y) < 6}. For 1 < j < k, let Cj = BxXS)\ ^{Zl B^X^) . Then consider 
the following discrete mm-space {Y,p): Y = {yi,y2, . . . ,yk, z}, v{yi) = ^{Ci), z/(z) = 
1 - E!=i Pi.Ci), d'{yi, yj) = d{xi, xj), d'{yi, z) = 1 . 

Lemma 7.2. Let {X,p),{Y,u) as above. T/ien □i(X,F) < 3e. 

Proof Let ^ : X ^ r be defined the following way. ^{d) = yi, ^(X\ uf^^ C,) = z . Then 
Ui{^!-\d'), d)<3e. Indeed, \<i/-\d') - d\ < 3e on Q x Cj and p{U^=^Ci) > 1 - e . □ 
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The following lemma is trivial. 

Lemma 7.3. For each m > and e > 0, there exists some 6 > such that if {G,fi) and 
{H, u) are discrete mm-spaces on the same set {ai, 02, ... , am} such that for all 1 < i < m 
|/i(aj) — i>{ai)\ < 6 and for all I < i,j < m, {ddai, aj) —duiai, aj)\ < 6 then Q_i{G, H) < e. 

Now let {Xn}'^=i C X be mm-spaces as in the statement of the proposition, and let Z be 
the support of X- By Lemma [3?T] and Lemma m| Z G x- Pick e > 0. Let Xi! 2^2' • • • ; 2£fc ^ Z 
and < 6 < e such that 

• ^{ul,B^^i6))>l-e. 

• For each l<i<k, ^{B^^{6)\B'^^{6)) = , where B'^^{6) = {y | dx(x,y) < 6} 
Now let us consider {x", Xg, . . . , x^} C X„ such that Xj = For any fix g > 

(6) {n I (5.^(5)) - /ix(i?x.(5))l <q}ecu 

Indeed, for any 6" < 6 < 6' 

So ([6]) follows from our condition on negligibility of the boundary of the balls. Similarly, 

for any j, 

{n I f^xACj) - /ix(C,)| <q}eu , 
where = U^i B^n(5). By Lemmas O and Ol 

{n I □i(X„,Z) < 4e) G w. 
Hence the proposition follows. □ 

According the proposition, any class of x closed under taking ultralimits is precompact in 

(x,Oi)- 

Example 4. Let {C{n) > 0}'^^^, {D{n) > 0}'^^^ be two sequences of integers such that 
lim„_^oo D{n) = . Then Xc,d C x is defined as the set of mm-spaces for which 

fx{xEX I ^(5i/„(x)) < C{n)} < D{n) . 

By definition, the support of any ultralimit of a sequence in Xc,d has full measure, so the 
ultralimit in also in the class Xc,d (see |5j Section 31/2.14) 

8. LiPSCHITZ FUNCTIONS AND THEIR ULTRALIMITS 

8.1. Lipschitz maps and qmm-spaces. Let {X,fi,dx) be a qmm-space and F be a 
compact metric space. We say that a measurable map / : X — > y is a 1-Lipschitz, if 
for fi X /i-almost all pairs (xi,X2) G X x X, J, dx{xi,X2) > /(X2)) . Note that 

the metric space structure is still well-defined on Lipi{X,Y). Also, we can define the sets 
M{X,Y) C V{Y). 
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Lemma 8.1. If Xi ~ X2 (D^{Xi, X2) = 0), then Lipi{Xi,Y) and Lipi{X2,Y) are iso- 
morphic. Also, the sets Ai{Xi,Y) and Ai{X2,Y) are equal. 

Proof. Let $ : [0, 1] — t- Xi be a measurable map. Then Lipi{^~^{Xi),Y) is isomorphic to 
Lipi{Xi,Y). Hence our lemma immediately follows from Theorem [2J □ 

Now let {Xn}'^=i C X and F be a compact metric space. Let : X„ — )• F be a sequence 
of 1-Lipschitz functions. 

Lemma 8.2. The ultralimit of {fn}°°, f : X — )• F is 1-Lipschitz and limt^(/„)j,(/i„) = 
f*(/ix) • 

Proof. Let Xi = lim^ x^, X2 = lim^^ x\. Then 

(ix(xi,X2) = \imdx„{xl,xl) > limrfy(/„(a;^), = dy(f (xi), f (xa)) . 



Now let (7 : F — 7- R be a continuous function. Then (7) = {fin, 9 ° fn) and 

(f*(/xx), 5-) = (a^x, goi) Since lim^ go fn = goi,hj Proposition O, 

lim((/„)^(/i„),^) = (t(/ix),^) • 

U} 

That is lim^(/„)*(/i„) = f*(/ix) □ 



Let us consider the space (X,/ix,d*), where X and d above. 
Lemma 8.3. f is still 1-Lipschitz on (X, yUx,d*). 

Proof. Let us apply Lemma l2.ll for the A^2-nieasurable function df(x, y) = d(x, y) — 
|f(x) — f(y)| . Since df is /ix x /ix-almost positive, the function 4. d* — |f(x) — f(y)| is 
/^x X /ix-almost positive as well. Therefore, f : (X,/ix,d*) — )• F is 1-Lipschitz. □ 

Lemma 8.4. Let {X,n,,d*) he a separable realization of (X,yUx,d*). Then there exists 
f e Lipi{X, F) such that f^{fi) = t(/ix) • 

Proof. Let (X', (d*)') be a separable realization of (X, /xx, d*) for which f is measurable. 
Note that such separable realization exists, since any separable extension of a separable 
realization is a separable realization. Then for this particular realization the function / 
must exist. Since Lipi{X,Y) depends only on the Dj^-equivalence class of X, the lemma 
follows. □ 



We can summarize the previous lemmas in a proposition. 

Proposition 8.1. Let {Xn}'^=i C x converging to a qmm-space {X,fi,d*) in sampling. 
Also let fn G Lipi{Xn,Y) such that {fn)*{fJ'n) i^- Then there exists f G Lipi{X,Y) such 
that = u. 

Proposition 8.2. Let {X, fix,d*) be a qmm-space, Z be a compact metric space and 
f G Lipi{X, Z) . Then there exists {X„}JJ^j^ C x o^'^ {fn G Lipi(X„, Z)}^^ such that 

{fn)*{f^n) (/)*(/^) • 
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Proof. Let {Xn}^^^ be the discrete spaces as in Theorem[5l We define by /„(z) = f{xi). 
That is /„ = / o 7r„, where 7r„ : X„ — )■ X is the natural map. Then 

lim{fn)*{fin) = f*(Aix) = (/ o vr)^(/ix) = /*(/^) • □ 
8.2. The proof of Theorem [E 

Proposition 8.3. Let Y be a compact metric space and < n' < k, < 1. Let {z/„}5^]^, u G 
ViY) such that Un ^ ly. Then 

hmsup (izam(z/„, k) < diamlu, k!) . 



hminf diam{i>n, k) > diam{i>, k) . 

Proof. First, let Yq d Y he a. closed set such that diamiYo) = t and v(Yq) > 1 — k,'. 
Let Y^ = {y E Y \ c/y(?/,Fo) < e} • Pick a continuous function g : Y ^ [0, 1] such that 
g{Y,/2) = 1, g{K') = 0. Then 

limsup /^^(y,;) > lim / gdun= / gdu > I ~ k' . 

Hence, for large enough n, 

diamiym f^) <t + 2e. 

Therefore, limsup„^g^ (imm(z/„, k) < diamlu, k'). One should note that 
limsup„^oo (iiam(z/„, n) < diamlu, n) does not always hold. 

Now let y„ C y be closed subsets such that diam{Yn) < t and UniYn) > 1 — k. We can 
suppose, by taking a subsequence, that {^nj^^i converges to a closed set Yq d Y 'va. the 
Hausdorff topology. Then, cimm(Fo) < ^- Let (7 : F — )■ [0, 1] be a continuous function such 
that g{Y^/2) = 1 and g{Yf) = 0. Then 

liminf z/„(y„) < lim / g du^ = / gdu < u{Y^) . 

Hence i^iY^) > 1 — k and diam{Y^) <t + 2e. That is liminf„_^oo diam[vrii 1^) > diam^v, k) . 

□ 

Lemma 8.5. Lei {X,fi,d*) be a qmm-space and < n' < n. Then 

• for all {Xn}n=i C X such that {X^j^^i 4 X 

lim sup ObsDiamyiXn, n) < ObsDiamy^X, k') . 

n— >-oo 

• There exists {Xn}'^=i A X such that 

Yrni'mi ObsDiamY^Xn, k) > ObsDiamyiX, k) . 
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Proof. Let {Xn}n=i A X. Pick /„ E Lipi{Xn,Y) such that 

diam{{fn)*iiJ^n), n) > ObsDiamyiXn, Let {(/nJ*(AinJ}^i e V(Y) be an arbitrary 

convergence subsequence such that 

hm diam{{fn^)^{jink), f^) = hm sup 06sDiamy(X„, k) . 

Then by Proposition 18.11 there exists / G Lipi{X,fi) such that {fnk)*{f^nk) ~^ /*(/^) • By 
the previous proposition, 

hmsup ObsDiamyiXn, n) < ObsDiamyiX, k') . 

n— >oo 

Now let / G Lipi (X, Y) such that 

diam{f^,{fi), k) > ObsDiamy{X, k) — e . 



By Proposition I8.2[ there exists a sequence {Xn}'^=i C x and /„ G such that 

• {fn)*{lJ'n) • 

Therefore 

(7) hminf ObsDiamy{Xn, k,) > hminf diam{{fn)*{fin), ^) > ObsDiamy{X, k) — e . 
Since d?]) holds for all e > 0, the lemma follows. □ 

Now let us finish the proof of our theorem. Let < < k" < k, and /i„, d*)}^]^ 

be a sequence of qmm-spaces converging to {X,fj,,d*). Pick a sequence {Zn}'^^i C x such 
that 

• ObsDiarriy^Zn, k") + - > ObsDiamy {Xn, k) ■ 

By the previous lemma, 

lim sup 06sDmmy(X„, k) < lim sup 06s-Diamy(Z„, k") < ObsDiamy{X, k ) □ 

n— >-oo n— >oo 

9. The proof of Theorem H] 

Let (X, /i, c?*) be a qmm-space, < < 1, Ki < 1. Then S'ep(X, ki, K2, . . . , ^m) is 
defined as the supremum of 5's such that there exist disjoint measurable subsets {A,}™!, 
/^(A) > fi^i, with 

essinf^<zA„yeA, I d*{x,y) > 6 . 

Recall that 

essinfu I d* = mf{t \ n{p e U \l d*{p) > t) > 0} . 
Lemma 9.1. If Xi ~ X2 then Sep{Xi, ki, K2, . . . , Hm) = 'S'ep(X2, ki, /t2, . . . , k^) . 



Proof. Let \E' : [0, 1] — i- Xi be a measure preserving map. Then it is easy to see that 
Sep{'^^^{Xi), Ki, K2, ■ . . , Km) = Sep{Xi, Ki, K2, ■ ■ ■ , t^m)- Heucc the lemma follows from 
Theorem [2l □ 
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Lemma 9.2. Let C x converging in sampling to a qmm-space X . Then 

limsupS'ep(X„,fi;i,fi;2,---,Km) < Sep{X, Ki, K2, . . . , Km) ■ 

Proof. By taking a subsequence, we can suppose that lim„_^oo Sep{Xn, ki, K2, • • • , ex- 
ists. Let {A^, A^, . . . , A"^} be disjoint subsets such that fini^l^) > Kj and 

inf dxAK^ K) > Sep{Xn, ki, K2, . . . , k„) - - . 

n 

Let A* = hm^^Al. Then /ix(A*) > and 

inf d(A*, A-') > hm S'ep(X„, ki, K2, . . . , Km) • 

Let £ C be a separable subalgebra such that A* C £ for all 1 < i < m . Then by 
Lemma 12.11 



ess inf I d*{A\ A^) > lim Sep{Xn, ki, K2, . . . , t^m) ■ 
Therefore we have a separable realization Y of X such that 

Sep{Y, Ki, K2, • • • , i^m) > J-ifn Sep{Xr„ 
Thus the lemma follows from Lemma 19.11 □ 

Lemma 9.3. Let {X,fi,d*) be a qmm-space. Then there exist {y„}J^^ C x such that 
{Y„}'^^^ converges to X in sampling and 

lim Sep{Yn, /ti, ^2, . . . , Km) = Sep{X, Ki, , K2, . . . , Km) ■ 

n— >oo 

Let Ai, A2, . . . , Am C X such that for any 1 < i < j < m 

essinf^^^A„x2eAj ld*{xi,X2) > t. 
Choose a random sequence yi,y2, ■ ■ ■ such that 

and pick d{i,j) randomly according to the law d*{y{i), y{j))- Let us normalize the measure 
on Yn in such a way that /i„(-B") = /i(v4j), where 5" = | 2/i G Aj} . Then with probability 
one, [Yn, fin) converges to X in sampling and for any 1 < i < j < n, 

mU,dYAB?,BJ)>t. □ 
Now we finish the proof of Theorem HI Let (i*)}^^^ be a sequence of qmm-spaces 

converging to {X,fi,d*) in sampling. Let us pick a sequence {Zn}^=i C x such that 

• Sep{Zn, Ki, K2,. Km) + ^ > Sep{Xn, Ki, ^2, • • • , Km) ■ 
. {Z4~ 1 4 X. 

By the previous lemma, 

lim sup Sep{Xn, Ki, K2, . . . , Km) < lim sup Sep{Zn, ki, K2, . . . , Km) < Sep{X, Ki, K2, . . . , Km) □ 
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